Relevance Feedback Track Overview : TREC 2008 Chris Buckley , Sabir Research

Examining Overfitting in Relevance Feedback: Sabir Research at TREC 2007

Sabir Research participated in TREC-2007 in the Million Query and Legal tracks. This writeup focuses on the Legal track, and in particular on the relevance feedback and interactive tasks within the Legal track. The information retrieval software used was the research version of SMART 16.0. SMART was originally developed in the early 1960’s by Gerard Salton and since then has continued to be a l...

Overview of the TREC 2010 Relevance Feedback Track (Notebook)

This year the relevance feedback track further examined relevance feedback with a single document relevance feedback task. Seven groups participated in the track. At this time, relevance judging is on-going and no results are available. This notebook version of the track describes the track, presents the current status of the track, and includes participant summaries.

SabIR Research at TREC-9

Looking at Limits and Tradeoffs: Sabir Research at TREC 2005

Sabir Research participated in TREC-2005 in the Terabyte, Robust, and document retrieval part of the Question Answering tracks. This writeup focuses on the Robust track, and in particular on a “routing” run that took advantage of relevance judgements for the topics on the old trec V45 collection to construct queries for the new Aquaint collection. The s ̄ mart retro tool is described which given...

Overview of the TREC 2008 Legal Track

TREC 2008 was the third year of the Legal Track, which focuses on evaluation of search technology for discovery of electronically stored information in litigation and regulatory settings. The track included three tasks: Ad Hoc (i.e., single-pass automatic search), Relevance Feedback (two-pass search in a controlled setting with some relevant and nonrelevant documents manually marked after the f...